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Abstract 


Doe  way  to  reduce  the  compufurianal  requirement!  of  Simulated 
Vnnealing  placement  algorithms  is  to  use  a  faster  heuristic  to 
eplaee  the  early  phase  of  Simulated  Annealing.  Such  systems 
eed  to  know  a  starting  temperature  for  the  annealing  phase  that 
makes  the  best  use  of  the  existing  structure,  yet  does  an 
appropriate  amount  of  improvement.  This  paper  presents  a 
method  for  measuring  the  temperature  of  an  existing  placement 
based  on  analysis  of  the  probability  distribution  of  the  change  in 
cost  function.  Using  this  view  a  new  definition  of  equilibrium  is 
given  and  the  equilibrium  temperature  of  a  placement  is  defined. 
Temperatures  of  placements  produced  both  by  a  Simulated 
Annealing  and  a  Min-Cut  placement  algorithm  are  measured. 


t/e*/ 


1 1ntroduction  _ 

V 

The  success  of  the  Simulated  Annealing  algorithm  for" 
automatic  placement  [Sech85]  has  been  hindered  by  its  1 
excessive  computational  requirements.  Recent  work  on  standard 
cell  placement  algorithms  [Roee86,  Grov87,  Rose88]  has 
suggested  alleviating  this  by  using  a  two-stage  approach:  begin 
with  a  good  heuristic  such  as  the  Min -Cut  algorithm  (Dunl85) 
nd  follow  it  with  a  Simulated  Annealing-baaed  approach  for 
more  fine  optimization.  This  allows  a  tradeoff  between 
execution  time  and  quality.  A  critical  issue  in  this  approach  is  to 
decide  the  starting  temperature  of  the  Simulated  Annealing 
phase.  If  it  is  too  high,  then  some  of  the  structure  created  by  the 
first  phase  will  be  destroyed  and  unnecessary  extra  work  will 
have  to  be  done  in  the  Simulated  Annealing  phase.  If  the 
temperature  is  too  low  then  solution  quality  is  lost,  similar  to  the 
case  of  a  quenching  cooling  schedule  [Whit84]. 

This  paper  presents  a  technique  for  measuring  the 
temperature  of  a  placement  for  use  in  such  two-stage  systems. 

To  do  so,  we  present  a  new  view  of  Simulated  Annealing  state 
different  from  those  articulated  in  (Rome84,  Whit84,  Aart85]. 
The  principal  difference  is  that  we  look  at  probability 
distributions  of  the  change  in  cost  function  of  a  Simulated 
Annealing  state,  rather  than  the  absolute  cost  function.  Using 
this  view  we  give  a  definition  of  equilibrium  from  which  follows 
the  notion  of  the  equilibrium  temperature  of  a  placement. 

From  this  we  develop  a  measure  that  quantifies  the  nearness 
of  a  Simulated  Annealing  placement  to  equilibrium  and  give 
experimental  evidence  of  its  ability  to  detect  equilibrium.  This 
leads  to  a  method  for  measuring  the  equilibrium  temperature  of 
a  placement,  and  we  show  that  it  works  both  for  placements 
produced  by  a  Simulated  Annealing  and  a  Min-Cut  placement 
algorithm. 


The  determination  of  starting  temperature  for'  Simulated 
Annealing  in  two-atage  ayatemt  hat  not  been  seriously 
addressed  before.  Both  [Roae86JRoae88]  and  [Grov87] 
introduce  the  question  but  avoid  answering  it  by  choosing  a 
starting  temperature  baaed  simply  on  prior  experience. 

2  Definition  of  Equilibrium  and  Temperature 

In  previous  discussions  of  cooling  schedules  and 
convergence  [Rome84,  Whit84,  Aart85],  the  Simulated 
Annealing  state  has  been  represented  either  as  the  probability 
distribution  of  the  absolute  coat  P  (C  ),  or  the  set  of  transition 
probabilities  from  every  state  i  to  every  other  state  j,  Tjj.  We 
suggest  a  different  view  that  gives  mare  information  about 
equilibrium  dynamics:  the  probability  distribution  of  the  change 
in  cost  function  from  the  current  stale.  P  (AC  )  is  the  probability 
that  a  given  state  under  a  Simulated  Annealing  process  with  a 
particular  generation  function  [Rome84]  will  generate  a  move 
with  a  change  in  cost  function  of  AC.  /*(AC)  varies  with 
temperature  (T)  and  as  moves  are  made. 

We  can  use  this  view  to  give  a  different  perspective  on  the 
equilibrium  of  a  Simulated  Annealing  process.  Since  at 
equilibrium  the  absolute  cost  function  no  longer  changes,  this 
implies  that  the  expected  value  of  the  change  in  cost  function  is 
zero: 

E  (AC )  =  0  (1) 

An  expression  for  E  (AC  )  can  be  formed  assuming  that  P  (AC  ) 
is  known: 


C(AC)  =  2AC  P (^C )  P (AC )  d AC 


(2) 


Pacx*p  (AC  )  is  the  probability  that  the  acceptance  function  will 
accept  a  move  with  cost  AC^[Rome84],  It  commonly  has  the 

value  1  for  AC  £0  and  e  for  AC  >0  [Seeh85].  We  note 
here  that  P  (AC )  in  equation  (2)  must  be  the  distribution 
measured  on  a  running  Simulated  Annealing  process  at  the 
equilibrium  temperature.  This  distribution  it  difficult  to 
measure,  and  will  be  direussed  further  in  Section  3. 1. 

Using  this  P/ieetpt  (AC  )  we  can  split  equation  (2)  into  two 
parts  and,  at  equilibrium  from  equation  (1)  we  cen  equate  it  to 
zero: 

JaC/>(AC)</AC  +JaC/>(AC)*-7^</AC  =0  (3) 

Thus  equilibrium  can  now  be  defined  as  the  state  where,  at  a 
given  T  —T^,  the  distribution  /*(AC)  satisfies  equation  (3). 
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Convener,  the  equilibrium  temperature  at  s  placement  with  a 
diKributioo  P  {AC  )  is  the  temperature,  T^,  for  which  equation 
(3)  is  satisfied. 

2.1  An  EquUlbflum-NcamMS  Me—urt 

Using  equation  (3)  we  can  invent  a  measure  at  the  nearness 
of  a  given  Simulated  Annealing  state  to  equilibrium.  Define  E  _ 
to  be  the  absolute  value  of  the  first  term  in  the  equation,  that  it 

E.  -  I  ^ AC  P{AC)dAC  I 

Similarly  let  £+  be  the  second  term  of  equation  (3): 

—AC 

E+  =  JaC  P(AC)  e^dAC 

'Where  Tm  is  the  temperature  of  the  Simulated  Annealing 
process.  We  can  now  define  the  Con  Force  Ratio,  (CFR)  as: 

CFR  =  x  100  (4) 

The  closer  CFR  is  to  30%  (the  expected  value  of  the  good 
moves  being  equal  to  the  expected  valuer  of  the  bed  moves, 
£.  =  £+)  the  closer  the  system  is  to  equilibrium. 


Figure  1  -  CFR  vs  Move  as  Process  Achieves  Equilibrium 


All  experiments  in  this  paper  use  a  placement  of  the  833 
standard  cell  Primary  1  circuit  from  the  freas-Robeits  standard 
cell  benchmark  suite  [Prea87].  The  placement  was  produced  by 
the  SALTOR  Simulated  Annealing  placement  program 
[Rose86,Ro»e88],  which  is  based  on  the  ideas  of  the  Timberwolf 
standard  cell  placement  program  [Secb8S].  Figure  1  is  a  plot  of 
CFR  versus  generated  move  number  for  a  Simulated  Annealing 
process  running  on  circuit  Primary  1,  as  it  goes  from  non¬ 
equilibrium  to  equilibrium  at  temperature  400  changing  to  300. 
CFR  is  determined  by  keeping  a  window  of  AC  values 
multiplied  by  the  Pacc*p  function  md  using  this  to  calculate  E+ 
and  E-  in  this  figure  the  CFR  comes  down  from  an  initial 
value  of  33%  and  hovers  around  30%.  This  shows  that  the  CFR 
indicatrs  when  equilibrium  has  been  achieved.  It  varies  about 
the  50%  point  due  to  the  stochastic  nature  of  the  algorithm  and 
the  approximation  of  measuring  the  CFR  in  a  finite  window. 


3  Measuring  Temperature 

As  defined  in  Section  2,  the  temperature  of  a  placement  is 
the  temperature  at  which  the  Simulated  Annealing  process 
running  on  the  placement  is  in  equilibrium,  h  this  section  we 
present  a  method  for  measuring  the  temperature  of  an  arbitrary 
placement 

The  method  is  called  the  CFR  Binary  Search  and  has  the 
following  outline: 

1.  Measure  P  (AC  )  for  die  given  circuit  under  the  Simulated 
Annealing  process.  This  is  discussed  in  detail  in  Section 
3.1. 

2.  Set  the  starting  search  temperature,  Tm ,  arbitrarily. 

-6C 

3.  Based  on  the  current  Tm,  calculate  P Amp  {AC )  =  e  T’ 
for  AC  >0  and  =  1  for  AC  £0. 

4.  Calculate  the  Cost  Force  Ratio,  CFR,  using  />AcM?t(AC ) 
and  equation  (4). 

5.  If  CFR  <  30,  reduce  Tm  according  to  a  binary  search  and  go 
to  step  3; 

If  CFR  >  30,  increase  Tm  according  to  a  binary  search  and 
go  to  step  3. 

6.  When  CFR  =  30,  Tm  is  the  equilibrium  temperature,  TH . 
Finish. 

Each  iteration  of  the  CFR  Binary  Search  requires  only  the 
recalculation  of  the  positive  portion  of  the  acceptance  function 
probability,  PAcctp{AC ),  and  subsequently  E +  and  CFR  since 
£_  does  not  change  with  Tm.  Note  also  that  P (AC )  need  only 
be  generated  once.  This  is  important  since  it  takes  many  moves 
(10*  to  10s)  to  get  an  accurate  picture  of  the  probability 
distribution. 

3.1  Measurement  of  the  Probability  Distribution 

A  key  and  difficult  step  in  the  CHI  Binary  Search 
temperature  measurement  procedure  is  the  measurement  of  the 
distribution  P  (AC ).  There  are  two  possible  methods: 

1.  Static  Measurement  P(AC )  is  measured  by  generating 
(but  not  accepting)  moves  in  the  Simulated  Annealing 
process  on  tbe  placement,  and  recording  the  frequency  with 
which  each  cost  occurs.  These  virtual  moves  do  not  change 
tbe  placement 

2.  Dynamic  Measurement  P  (AC  )  is  measured  by  generating 
and  accepting  moves  on  the  placement  Here  the  placement 
does  change  as  the  measurement  is  made. 

For  the  general  case  of  any  Simulated  Annealing  application  a 
Katie  measurement  will  not  give  the  correct  distribution.  This  is 
because  s  static  measurement  of  P(AC)  could  be  taken  when 
the  system  was  at  a  local  (but  not  global)  optimum.  In  this  case 
there  would  be  no  good  (negative)  moves  generated  snd  since 
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£_  would  thus  be  0  the  temperature  would  appear  to  be  0,  which 
it  incorrect  in  the  cate  of  a  local  optimum.  Similar  piobiemt 
can  occur  when  the  sate  it  at  or  near  ditcaotinuitiet  in  the 
energy  landscape. 

The  dynamic  measurement  approach  must  tun  the  Simulated 
Annealing  process  at  its  equilibrium  temperature.  Using  a 
different  temperature  would  cause  the  placement's  temperature 
to  change.  Unfortunately  the  equilibrium  temperature  is  the 
quantity  we  are  seeking,  and  is  not  known.  This  is  a  dilemma  not 
unlike  the  Heisenberg  uncertainty  principle:  the  act  of  measuring 
the  temperature  this  way  can  cause  the  temperature  to  change. 

An  alternative  is  to  measure  /*(AC)  using  the  static  method, 
and  to  determine  how  accurate  this  is  at  an  lyrwiTntjm  The 
accuracy  is  entirely  problem  dependent  -  it  depends  on  the 
energy  landscape  of  the  underlying  Simulated  Annealing 
formulation.  We  have  experimented  to  delennme  the  accuracy 
for  the  standard  cell  placement  problem  and  have  found  that  the 
static  measurement  of  P  (AC  )  is  almost  exactly  the  same  as  the 
dynamic  measurement.  Figure  2  shows  a  plot  of  a  static 
distribution  and  a  dynamic  distribution  measured  on  circuit 
Primaiyl  at  temperature  300.  Measurements  and  numerical 
comparisons  on  this  and  several  other  circuits  at  various 
temperatures  have  shown  very  small  differences  between  die 
static  and  dynamic  measurements.  Thus  we  will  use  the  Satie 
measurement  of  P  {AC)  in  the  temperature  measurement 
algorithm. 
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Figure  2  -  Comparison  of  Static  and  Dynamic  Measurement 


3.2  Measurement  of  Annoallng  Placements 

The  CFR  Binary  Search  was  used  to  measure  the 
temperature  of  a  set  of  Primary  1  placements  produced  by  the 
SALTOR  Simulated  Annealing  placement  program 
[Rose86,Roae88  ].  Each  placement  wee  measured  statically  using 
N  ■  100,000  virtual  moves  to  experimentally  determine  P  (AC  ). 
Table  1  gives  the  temperature  at  which  each  placement's 
Simulated  Annealing  process  was  terminated  (while  in 
equilibrium),  and  the  meaaned  temper  sure  using  the  CFR 
Binary  Search. 

The  measured  temperature  is  quite  accurate  S  the  higher 
temperature,  usually  lest  than  7%  error.  The  lower  temperature 
measurements  are  proportionately  less  accurate.  The  error  is 


due  to  two  effects:  Firs,  there  is  a  slight  difference,  as 
discussed  above,  between  the  sstjc  and  the  (more  correct) 
dynamic  measurement  at  P(6C).  Second,  s  tower 
temperatures,  there  are  fewer  negative  moves,  and  so  the 
accuracy  of  £_  decreases,  decreasing  the  accuracy  of  CFR  and 
hence  the  temperature  measurement 


Produoed 

nperature 

CFR  Binary  Search 
Measured  Temp 

Difference 

500 

496 

A 

405 

420 

+15 

294 

285 

-11 

213 

215 

+2 

153 

164 

+11 

99 

97 

-2 

57 

+3 

28 

28 

0 

9 

15 

+6 

2 

4 

+2 

Table  1  -  Temperature  Measurement  of  Annealing  Placements 


This  las  point  can  be  seen  experimentally:  figure  3  is  a  plot 
of  the  percentage  standard  devision  of  the  measured 
temperature  as  a  function  of  the  number  of  virtual  moves.  N,  for 
temperatures  28,  153  and  405.  The  standard  deviation  was 
calculated  from  five  runs  s  each  number  of  virtual  moves. 


2  3  4  5 

loglO  (Number  of  Virtual  Moves) 

Figure  3  •  Variation  of  Temperature  vs.  Number  of  Moves 

The  variation  is  a  decreasing  function  of  N,  as  would  be 

expected.  The  figure  illustrates  the  increase  in  percentage  _ 

variation  s  lower  temperature. 

4  Measurement  of  Min-Cut  Placements 

Our  goal  is  to  detrnmar  the  starting  temperature  when  O 
switching  from  s  ncn-smesling  placement  algorithm  to  an 
annealing-baaed  one.  In  this  section  we  teS  the  ideas  presented 
above  on  the  Min-Cut  placement  algorithm  [Dunl85]. 

Several  terms  first  need  to  be  defined  for  Min-Cut _ 

placements,  as  shown  in  Rgure  4.  A  Min-Cut  placement 

i/or 

Special 
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algorithm  ia  characterized  by,  among  other  thing*,  the  order  and 
pacing  of  the  cat  line*  applied,  fa  figure  4,  the  rectangle 
itpwmti  the  entiie  placement,  over  which  ia  laid  a  aet  of 
vertical  and  horizontal  cut  tinea.  If  the  pacing  of  the  vertical 
cot  tinea  ia  V  and  of  the  horizontal  cut  lines  ia  H ,  then  the  cut 
ar an.  A,  ia  given  by  A  =  V  xH. 
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Figure  4  -  Definition  of  Cut-Area 


Delia  Method.  It  find*  the  temperature  of  a  placement  by 
running  a  dynamic  annealing  procea*  on  the  placement  over  a 
range  of  temperature*.  The  percentage  difference  in  abaolute 
coat  function  after  (100  move*  per  cell  are  made)  ia  meaatned. 
When  a  temperature  ia  found  for  which  thia  difference  ia  lea* 
than  2%,  that  ia  taken  a*  the  temperature  of  the  placement  Uric 
is  a  direct  way  of  experimentally  finding  the  temperature  at 
which  the  change  in  cost  function  is  near  0.  Table  2  gives  the 
temperatures  determined  by  the  Delta  Method,  and  the 
difference  between  the  CFR  Binary  Search  and  the  Delta 
Method.  The  CFR  Binary  Search  measurement  for  Min-Cut 
placements  is  not  as  accurate  at  those  for  Annealing-produced 
placements,  yet  it  does  track  the  temperature  reasonably  well. 

The  CFR  Binary  Search  method  consistently  overestimates 
the  equilibrium  temperature  due  to  the  fact  that  a  min -cut 
placement  it  not  in  equilibrium,  as  discussed  above. 


One  difficulty  with  measuring  the  temperature  of  non- 
annealing  produced  placements  it  that  the  definition  of 
temperature  presented  in  Section  2  depend*  on  the  associated 
Simulated  Annealing  process  being  in  equilibrium.  It  is  clear, 
however,  that  a  placement  produced  by  a  non- annealing 
algorithm  is  not  in  equilibrium.  Thus  we  mutt  make  an 
approximation  and  assume  dial  a  min-cut  placement  can  be 
thought  of  as  being  in  equilibrium  at  some  temperature.  The 
effect  of  this  approximation  it  measured  in  the  next  eection 
where  we  compere  the  CFR  Binary  Search  method  with  a  more 
direct  method. 

4.1  Measurements 


5  Conclusions 

We  have  presented  a  method  for  determining  the 
temperature,  in  the  Simulated  Annealing  sense,  of  an  arbitrary 
placement.  It  naes  a  new  view  of  Simulated  Annealing  state  that 
is  based  on  the  probability  distribution  of  the  change  in  cost 
function.  The  temperature  of  several  Simulated  Annealing 
placements  have  been  measured  with  good  accuracy.  The 
temperature  of  a  set  of  Min-Cut  placements  has  also  been 
measured.  This  method  is  useful  for  determining  the  starting 
temperature  when  switching  from  a  non-annealing  based 
placement  strategy  to  an  annealing-based  one. 
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Using  the  CFR  Binary  Search  method  we  measured  the 
temperature  of  several  Min-Cut  placements  with  different  cut 
areas.  These  placements  were  produced  by  the  ALTOR 
standard-cell  placement  program  [Rose85].  Table  2  gives  the 
measured  temperature  for  each  placement  and  its  cut  area. 


Cut  Ana 
UliiVlO* 

Tempo  rntur 
Binary  Search 

a  Measured 

Delta  Method 

Difference 

2021 

398 

374 

+24 

1011 

234 

200 

+34 

5053 

162 

132 

+30 

252.6 

124 

96 

+28 

1263 

91 

«7 

+24 

6322 

73 

50 

+23 

3138 

49 

40 

+9 

2524 

40 

32 

+8 

1Z60 

34 

30 

+4 

7.697 

29 

27 

+2 
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_ 

26 
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To  check  the  CFR  Binary  Search  measurement*,  the 
tements  were  measured  uring  a  different  approach,  called  the 


